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We analyze the replicator-mutator equations for the Rock-Paper-Scissors game. Various graph- 
theoretic patterns of mutation are considered, ranging from a single unidirectional mutation pathway 
between two of the species, to global bidirectional mutation among all the species. Our main result 
is that the coexistence state, in which all three species exist in equilibrium, can be destabilized by 
arbitrarily small mutation rates. After it loses stability, the coexistence state gives birth to a stable 
limit cycle solution created in a supercritical Hopf bifurcation. This attracting periodic solution 
exists for all the mutation patterns considered, and persists arbitrarily close to the limit of zero 
mutation rate and a zero-sum game. 


I. INTRODUCTION 

In the children’s game of Rock-Paper-Scissors, paper 
wraps rock, rock smashes scissors, and scissors cut pa¬ 
per. Theoretical biologists have used this game as a 
metaphor in ecology and evolutionary biology to describe 
interactions among three competing species in which each 
species has an advantage over one of its opponents but 
not the other a situation that can result in cyclic 

dominance nrnHii]. Interactions of this type occur be¬ 
tween three competing strains of E. coli [5] as well as in 
the mating strategies of side-blotched lizards [12]. The 
Rock-Paper-Scissors game also has applications outside 
of biology. For example, it has been used to analyze the 
dynamics of a sociological system with three strategies in 
a public goods game [T3] . 

Mathematically, the dynamics of the Rock-Paper- 
Scissors game is often studied using the replicator equa¬ 
tions EE], a system of coupled nonlinear differential 
equations that have been applied in diverse scientific set¬ 
tings. For example, replicator equations have been used 
to model the evolution of language, fashion, autocatalytic 
chemical networks, behavioral dynamics, and multi-agent 
decision making in social networks HHilllHSo]. 

In the specific context of the Rock-Paper-Scissors 
game, the replicator equations are most often studied 
in the absence of mutation [IHSIEI]- The dynamics in 
that case tend to exhibit one of three types of long-term 
behavior, depending on a parameter e that character¬ 
izes how far the game is from being a zero-sum game. 
The three types of behavior are: (i) stable coexistence of 
all three species, (ii) neutrally stable cycles that fill the 
whole state space, and (iii) large-amplitude heteroclinic 
cycles in which each species in turn almost takes over the 
whole population and then almost goes extinct. 

In 2010, Mobilia [7] broke new ground by asking what 
would happen if the strategies are allowed to mutate into 
one another. For simplicity he assumed that every species 
could mutate into every other at a uniform rate ji. For 
this highly symmetrical case (which we call global mu¬ 
tation), Mobilia [7] found a new form of behavior, not 
present in the mutation-free case: the system could set¬ 


tle into a stable limit-cycle oscillation, born from a su¬ 
percritical Hopf bifurcation. 

In this paper we investigate what happens in other mu¬ 
tational regimes. For example, we consider the dynamics 
when precisely one species mutates into one other, or 
when two species mutate into two others, as well as more 
complicated patterns of mutation. In every case we find 
that stable limit cycles can occur, and we calculate the 
regions in parameter space where such attracting peri¬ 
odic behavior occurs. 

Our work was motivated by a question that arose in 
one of our previous studies [22]. There we had explored 
the dynamics of the repeated Prisoner’s Dilemma game 
for three strategies: always defect (ALLD), always co¬ 
operate (ALLC), and tit-for-tat (TFT). We incorporated 
mutations at a rate /i and a complexity cost c of play¬ 
ing TFT into the replicator equations and analyzed the 
six possible single-mutation cases (exactly one strategy 
mutates into one other with rate ji) as well as the global 
mutation case (each strategy mutates into the two others 
at the same rate /i). Our results showed that stable limit 
cycles of cooperation and defection were possible for ev¬ 
ery pattern of mutation we considered. What was partic¬ 
ularly striking was that stable cycles occurred for param¬ 
eter values arbitrarily close to the structurally unstable 
limiting case of zero mutation rate and zero complexity 
cost (/i = 0,c = 0). We conjectured, but were unable 
to prove, that stable limit cycles would continue to exist 
near this point for any pattern of mutation, not just the 
single-mutation patterns we looked at in Ref. [22] . 

In hopes of finding a more tractable system where the 
same phenomena might occur, we turned to the Rock- 
Paper-Scissors game. The analogous question is, does 
this system always exhibit stable limit cycles for parame¬ 
ters arbitrarily close to the zero-sum, zero-mutation-rate 
limit, for any possible pattern of mutation? For single 
mutations, the answer is yes, as we will show below. For 
arbitrary patterns of mutation, the answer again appears 
to be yes, but we have only managed to prove this un¬ 
der a further constraint, namely that the mutation pat¬ 
tern preserves the symmetrical coexistence state where 
all three strategies are equally populated. 
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II. ROCK-PAPER-SCISSORS GAME 

The standard Rock-Paper-Scissors game is a zero-sum 
game with payoff matrix given in Table |lj The entries 
show the payoff received by the row player when playing 
with the column player. 


TABLE L Payoff matrix of a zero-sum Rock-Paper-Scissors 
game 



Rock 

Paper 

Scissors 

Rock 

0 

-1 

1 

Paper 

1 

0 

-1 

Scissors 

-1 

1 

0 


According to the payoff matrix in Table |lj each species 
gets a payoff 0 when playing against itself. When playing 
against a different species, the winner gets a payoff 1 
while the loser gets —1. 

A more general payoff matrix, considered in Ref. [3, 
allows for non-zero-sum games. Now the winner gets a 
payoff 1 and the loser gets —e, as shown in Table [TT| This 
game is zero sum if and only if e = 1. 


TABLE 11. Payoff matrix of a Rock-Paper-Scissors game with 
parameter e. The game is a zero-sum game when e = 1. 



Rock 

Paper 

Scissors 

Rock 

0 

—e 

1 

Paper 

1 

0 

—e 

Scissors 

—e 

1 

0 


For convenience, we redefine the entries of the payoff 
matrix so that the zero-sum case corresponds to e = 0 
rather than e = 1. The payoff matrix for the rest of this 
paper is shown in Table |ml 


TABLE III. Payoff matrix of a Rock-Paper-Scissors game, 
redefined so that the zero-sum game has e = 0. 



Rock 

Paper 

Scissors 

Rock 

0 

-(e + 1) 

1 

Paper 

1 

0 

-(e+1) 

Scissors 

-(e + 1) 

1 

0 


III. GLOBAL MUTATIONS 

The most symmetrical Rock-Paper-Scissors game with 
mutation is the one with global mutation, where each 
species mutates into the other two with a rate /i, as shown 
in Fig. 

Suppose that global mutation occurs in a well-mixed 
population with N individuals. Let x^y and 2 ; denote 
the relative frequencies of individuals playing rock, paper 
and scissors, respectively. Then x^y^z = l or z = 



— s R s R— 

FIG. 1. Pathways for global mutation. 

1 — X — y. By eliminating 2 : in this fashion, one can 
capture the dynamics of the three strategies by studying 
X and y alone. Following Ref. [7], the replicator-mutator 
equations can be written as 

i = a; (/a; - ?!') + M (-2a; + y + z) 
y = 2/ (/y -</>)+ M (-2y + x-\-z) (1) 

where fi is the fitness of strategy i, defined as its ex¬ 
pected payoff against the current mix of strategies, and 
0 = xfx + yfy + zfz is the average fitness in the whole 
population. For the payoff matrix defined above in Ta¬ 
ble [TTI| and using z = 1 — x — y^we find 

fx = l-x-{e + 2)y 

and 

fy = {e + 2)x + (e + l){y - 1). 

A conceptual disadvantage of eliminating 2 : in favor of 
X and y is that the system’s cyclic symmetry becomes 
less apparent. To highlight it, one can plot the phase 
portraits of the system on the equilateral triangle defined 
by the face of the simplex x y -\- z = 1, where 0 < 
x^y^z < 1. This mapping of the phase portrait onto the 
equilateral triangle can be achieved by using the following 
transformation: 



In what follows, all phase portraits will be plotted in 
(X, Y) space, but we will still indicate the values of x, ^ 
at the vertices of the simplex, since these variables have 
clearer interpretations. 

Equation Q has four fixed points: = 

(0, 0, 0), (1, 0,^ , (0,1, 0), and (|, |). The inner fixed 

point undergoes a Hopf bifurcation when yh = e/18, as 
shown in [7]. Moreover, the system undergoes three si¬ 
multaneous saddle connections when /i = 0, meaning 
that when /r = 0, there is a heteroclinic cycle linking 
the three corners of the simplex. Figure shows the 
stability diagram of Eq. 0 as well as phase portraits 
corresponding to the different regions of Fig. |^a). 

Incidentally, the occurrence of the heteroclinic cycle is 
not an artifact of the global mutation structure assumed 
here. For any mutation pattern, y = 0 will always (triv¬ 
ially) yield a heteroclinic cycle linking the three corners 
of the simplex, since that cycle is known to be present 
in the absence of mutation [BElllllllg]. Thus, all the 
subsequent stability diagrams in this paper will show a 
saddle connection curve along the line y = 0. 
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FIG. 2. (Color online) Stability diagram for Eq. 0 and 
its associated phase portraits, in the case of global mutation, 
(a) Stability diagram. Locus of supercritical Hopf bifurca¬ 
tion, solid blue curve; saddle connection, dotted red line, (b) 
Phase portrait corresponding to Region 1 of the stability dia¬ 
gram. The system has a stable interior point, corresponding 
to coexistence of all three strategies, (c) Phase portrait cor¬ 
responding to Region 2. The system has a stable limit cycle. 


FIG. 3. (Color online) Stability diagram and phase portraits 
for Eq. In this single-mutation case, rock x mutates into 
paper y at a rate fi: x A- y . (a) Stability diagram. Super¬ 
critical Hopf bifurcation, solid blue curve; saddle connection, 
dotted red line, (b) Phase portrait corresponding to Region 
1 of the stability diagram. The system has a stable interior 
point, corresponding to coexistence of all three strategies, (c) 
Phase portrait corresponding to Region 2. The system has a 
stable limit cycle. 


IV. SINGLE MUTATIONS 

Because of the cyclic symmetry of the Rock-Paper- 
Scissors game, it suffices to consider two of the six possi¬ 
ble single-mutation pathways. So without loss of gener¬ 
ality, we restrict attention to rock (x) A paper (y) and 
paper (y) A rock (x). 

The two cases are qualitatively different. In the first 
case, the direction of mutation reinforces the system’s 
inherent tendency to flow from rock to paper. (Recall 
that paper beats rock, so trajectories tend to flow from 
rock to paper, as the paper population grows at rock’s 
expense.) By contrast, in the second case, the mutation 
pathway runs counter to this natural flow. 

A. Single mutation: x A y 

When rock mutates into paper, the system becomes 

X = X {fx - (t>) - l^x 

y = yify - (!>) + yx. (3) 

Figure [3| plots the stability diagram and phase portraits 
of Eq. ® . 


To derive the results shown in Fig. we observe first 
that Eq. ^ has three fixed points: (0,0), (0,1), and an 
inner fixed point (x^^y^), with 

^ (e + 3) Ai + e (Sjx + + Sjxe — 6) — 9 

~ 6 (e (e + 3) + 3) ’ 

^ —6/i + Ai + e (—3/i + e + 3) + 3 

^ 6 (e(e + 3) + 3) ’ 

where the quantity Ai is given by 

Ai = - 6ixe{e{e + 3) + 3) + (e(e + 3) + 3)^. 

These fixed points display some notable differences 
from those found above, when mutation was either ab¬ 
sent or global. For example, the state in which only rock 
exists, corresponding to the corner {x^y^z) = (1,0,0) of 
the simplex, is no longer a fixed point, since x is now con¬ 
stantly mutating into y. So paper must exist whenever 
rock does. The complicated interior fixed point (^^ 3 ,^ 3 ) 
can be regarded as a perturbation of (|, |), in the sense 
that = (| + A: I + A) where both A and 6y 

approach 0 as /r ^ 0 . 

Equation @ produces stable limit cycles when the in¬ 
terior fixed point undergoes a supercritical Hopf bifurca- 
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tion. This transition can be shown to occur at 

2 e(e + 2)(4e(e + 2) + 9) + 9 — 3^ — 3e(e + 2) 

=-7^- 

e 4e^ 4e^ 4e® ^ » 


The stable limit cycle created in the Hopf bifurcation 
grows into a heteroclinic cycle as /i ^ 0 . 


B. Single mutation: y x 


In the case where paper y mutates into rock x at a rate 
/i, the system becomes 

X = x{f^ -<t>) - IIX 

y = y{fv -4>) + yx. (4) 

Figure plots the stability diagram and phase por- 
traits of Eq. Note the existence of a new region in 
parameter space, bounded below by a transcritical bifur¬ 
cation curve. This region did not exist when the muta¬ 
tion was in the direction of the system’s inherent flow, 
depicted earlier in Fig. (The existence of such a re¬ 
gion also holds if there are multiple mutations, unless 
the inner fixed point is we will see below.) 

The results shown in Fig. [4] can be derived analytically, 
as follows. Because the direction of mutation y x here 
opposes the system’s inherent flow, the fixed points of 
Eq. @ now include a new fixed point on the 

boundary line given by ^ = 0 and x y = 1. The 
fixed points are thus ( 0 , 0 ), ( 1 , 0 ), an interior fixed point 
(^ 3 ,^ 3 ) similar to that found earlier, and a fourth fixed 
point on the boundary. The coordinates of the nontrivial 
fixed points are given by 

^ 6 /i + Ai + e(3/i + e + 3) + 3 

6(e(e + 3)+3) ’ 

^ _ (~2e — 3) Ai + e(—3/r + e(4e + 15) + 21) + 9 
^ 6e(e(e + 3) + 3) ’ 

* _ e + 1 + ■\/(e + 1)2 — 4/ie 

* _ e - 1 - v/(e + l)2 _4^g 

2/4 - 2e 

where Ai is given by the expression obtained earlier. 

As shown in Fig. Qa), the fixed point {x\^yX) exists 
only for parameter values above the transcritical bifur¬ 
cation curve. By linearizing about the fixed point and 
seeking a zero-eigenvalue bifurcation, we find that the 
transcritical bifurcation curve is given by 


e — y/e H- 1 

f^trans — ; Z. • 

+ 1 

Interestingly, the Hopf bifurcation curve for Eq. @ is 
identical to that for Eq. even though the two sys¬ 
tems have qualitatively different dynamics. We have no 



e 





FIG. 4. ^olor online) Stability diagram and phase portraits 
for Eq. 0, corresponding to a single mutation pathway in 
which paper y mutates into rock x at a rate y. Note that 
this direction of mutation goes “against the flow” in the fol¬ 
lowing sense: in the absence of mutation, paper beats rock 
and thus the flow normally tends to convert x into y. Thus, 
the direction of mutation assumed here opposes that flow, (a) 
Stability diagram. Supercritical Hopf bifurcation, solid blue 
curve; saddle connection, dotted red line; transcritical bifur¬ 
cation, dashed green curve. In the coexistence region above 
the transcritical bifurcation curve, rock coexists with paper 
at the stable fixed point, (b) Phase portrait corresponding to 
Region 1 of the stability diagram. The system has a stable 
interior point, corresponding to coexistence of all three strate¬ 
gies. (c) Phase portrait corresponding to Region 2. The sys¬ 
tem has a stable limit cycle, (d) Phase portrait corresponding 
to Region 3, where rock and paper coexist and scissors has 
gone extinct. The system has a stable point on the boundary 
line joining rock and paper. 


explanation for this coincidence. It does not follow from 
any obvious symmetry, as evidenced by the fact that the 
inner fixed points (^ 3 ,^ 3 ) are different in the two cases. 
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V. DOUBLE MUTATIONS 

If we allow mutations to occur along two pathways in¬ 
stead of one, and assume that they both occur at the 
same rate /i, then by the cyclic symmetry of the Rock- 
Paper-Scissors game there are four qualitatively different 
cases to consider. The analysis becomes more compli¬ 
cated than with single mutations, so we omit the details 
and summarize the main results in the stability diagrams 
shown in Figure The key point is that in every case, 
stable limit cycles exist arbitrarily close to the origin 
(e,/i) = ( 0 , 0 ) in parameter space, consistent with the 
conjecture discussed in the Introduction. 

Figure [^a) shows the stability diagram for the first 
case, defined by having one of the two mutations go in 
the direction of the system’s inherent flow and the other 
against it. An example is z A ^ and x y. As shown 
in Fig. I^a), the resulting stability diagram has three 
regions and resembles what we saw earlier in Fig. |^a). 
Nothing qualitatively new happens if both pathways go 
against the flow so this case is omitted. 

The second case occurs when both mutation path¬ 
ways go in the same direction relative to the flow, as 
in Fig. [^b). Then the stability diagram has only two 
regions, similar to Fig. |^a). 

The final case, shown in Fig.j^c), occurs when the two 
mutation pathways go in opposite directions between the 
same two species, as in x A ^ and ^ A x. Again, the 
stability diagram shows only two regions. The boundary 
between the regions turns out to be exactly straight in 
cases like this. Specifically, we And that the Hopf curve 
here is given by the line yh = e/ 6 . The key to the analysis 
is the observation that the interior fixed point reduces to 
X = y = z = ^ for this case. This convenient symmetry 
property eases the calculation of the Hopf bifurcation 
curve. Indeed, the Hopf curve continues to be straight, 
even for more complex patterns of mutation, as long as all 
three species are equally populated at the interior fixed 
point, as we will show next. 


VI. COMPLEX MUTATIONS 


The analytical treatment of the model becomes pro¬ 
hibitively messy as one adds more mutation pathways. 
To make further progress, let us restrict attention to mu¬ 
tation patterns that preserve {x,y) = (|, |) as the inner 
fixed point for all values of e and fi. These mutation 
patterns are shown in Table We computed the Hopf 
curve analytically for all of them and noticed something 
curious: The equation of the Hopf curve is always 


e 

3 X ( 7 ^ of mutations) ’ 
as shown in Table lEl 

To derive this formula, we write the replicator equa¬ 
tions for all the mutation patterns in Table [rV| as a single 



e 



e 



e 


FIG. 5. (Color online) Stability diagram of the replicator 
equations for different patterns of two mutations, both occur¬ 
ring at a rate y. Supercritical Hopf bifurcation, solid blue 
curve; transcritical bifurcation, dashed green curve; saddle 
connection, dotted red line, (a) Opposing mutations: z y 
and X A y. (b) Mutations in the same direction of circula¬ 
tion: z A X and X y. (c) Bidirectional mutation between 
the same two species: x y and y x. 


system: 

X = x{fx -<!)) + y-[ayX + a^x] + + jxz) 

y = vify - 0 ) + y-iPxV + Pzv] + ayX + jyz) 

Z = z{fz y{-[lxZ + Jyz] + azX + pzv)- (5) 

Here the indicator coefficients given by the various [3^ 

and 7 are set to 0 or 1 , depending on which mutation 
pathways are absent or present. For example, we set 
ay = 1 if X mutates into y. Otherwise, we set ay = 0. 
The same sort of reasoning applies to the various Pj and 
lk‘ 

To ensure that (^, ^) is a fixed point of Eq. ([^, the 
indicator coefficients must satisfy certain algebraic con¬ 
straints. These are given by 

A “1“ “1“ 

+ 7?/ = A + A 

+ A = 7a: + 7?/- 


( 6 ) 
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TABLE IV. Hopf curve for different mutation patterns 


Mutation patterns 
(rate y) 

# of mutations 

Hopf curve 

\ 

R S 

2 


/\ 

R^S 

3 


\ 
R’=» s 

4 

II 

Rfc* S 

6 



Using Eqs. (§ and <11 , one can then show that the fixed 
point (I, I) undergoes a Hopf bifurcation at 

e 

^ 3{ay c^z -\- Px Pz Ifx ly) ’ 

which yields the results in Table [IV| 

The upshot is that a curve of supercritical Hopf bi¬ 


furcations emanates from the origin in parameter space. 
Hence, for complex mutation patterns that preserve the 
fixed point {x^y) = (|, |), we have confirmed the conjec¬ 
ture that stable limit cycles exist for parameters arbitrar¬ 
ily close to the zero-sum, zero-mutation-rate limit of the 
replicator equations for the Rock-Paper-Scissors game. 


VII. DISCUSSION 

Our main result is that for a wide class of mutation 
patterns, the replicator-mutator equations for the Rock- 
Paper-Scissors game have stable limit cycle solutions. For 
this class of mutation patterns, a tiny rate of mutation 
and a tiny departure from a zero-sum game is enough to 
destabilize the coexistence state of a Rock-Paper-Scissors 
game and to set it into self-sustained oscillations. 

However, we have not proven that limit cycles exist for 
all patterns of mutation. That question remains open. 

Another caveat is that our results have been ob¬ 
tained for one version of the replicator-mutator equa¬ 
tions, namely, that in which the mutation terms are added 
to the replicator vector field. In making this choice we are 
following Mobilia [7] , who investigated the effect of addi¬ 
tive global mutation on the replicator dynamics for the 
Rock-Paper-Scissors game. But there is another way to 
include the effect of mutation in the replicator equations: 
one can include it multiplicatively as in, e.g.. Ref. [2]. In 
biological terms, the multiplicative case makes sense if 
the mutations occur in the offspring, whereas in the addi¬ 
tive case they occur in the adults. We found the additive 
case easier to work with mathematically, but it would be 
interesting to see if our results would still hold (or not) 
in the multiplicative case. 
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